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Abstract 

Using a characterization of Mutual Complete Dependence copulas, we show 
that, with respect to the Sobolev norm, the MCD copulas can be approximated 
arbitrarily closed by shuffles of Min. This result is then used to obtain a char- 
acterization of generalized shuffles of copulas introduced by Durante, Sarkoci 
and Sempi in terms of MCD copulas and the ^-product discovered by Darsow, 
Nguyen and Olsen. Since shuffles of a copula is the copula of the corresponding 
shuffles of the two continuous random variables, we define a new norm which is 
invariant under shuffling. This norm gives rise to a new measure of dependence 
which shares many properties with the maximal correlation coefficient, the only 
measure of dependence that satisfies all of Renyi's postulates. 
Keywords: copulas, shuffles of Min, measure-preserving, Sobolev norm 
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1. Introduction 

Since the copula of two continuous random variables is scale-invariant, cop- 
ulas are regarded as the functions that capture dependence structure between 
random variables. For many purposes, independence and monotone dependence 
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have so far been considered two opposite extremes of dependence structure. 
However, monotone dependence is just a special kind of dependence between 
two random variables. More general complete dependence happens when func- 
tional relationship between continuous random variables are piecewise mono- 
tonic, which corresponds to their copula being a shuffle of Min. See 
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Mikusinski et al. [13|, ll2| showed that shuffles of Min is dense in the class of all 
copulas with respect to the uniform norm. This surprising fact urged the discov- 



ery of the (modified) Sobolev norm by Siburg and Stoimenov [21 1 which is based 
on the ^-operation introduced by Darsow et al. 
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showed that continuous random variables X and Y are mutually completely 
dependent, i.e. their functional relationship is any Borel measurable bijection, 
if and only if their copula has unit Sobolev-norm. 

Darsow et al. 3, 15[ showed that for a real stochastic processes {Xt}, 
the validity of the Chapman-Kolmogorov equations is equivalent to the validity 
of the equations Cst — Csu * Cut for all s < u < where Cgt denotes the 
copula of Xs and Xt. It is then natural to investigate how dependence levels 
of A and B are related to that oi B. Aside from 11, M and W , the easiest 
case is when A and B are mutual complete dependence copulas. In light of 
our result on denseness of shuffles of Min in the MCD copulas, we shall show 
that if = ||B|| = 1 then \\A * B\\ = 1. Now, if ||A|| = 1 and C is a copula 
then we prove that A* C coincides with a generalized shuffle of C in the sense 
of Durante et al. 8]. We also give similar characterizations of shuffles of C 
and generalized shuffles of Min. These characterizations have advantages of 
simplicity in calculations because it avoids using induced measures. Then we 
use this relationship to obtain a simple proof of a characterization of copulas 
whose orbit is singleton (Theorem 10 in 8]). Note that there are many examples 
where shuffles of C, i.e. A * C or C * A, do not have the same Sobolev norm 
as C. However, we show that multiplication by unit norm copulas preserves 
independence, complete dependence and mutual complete dependence. 

Since left- and right-multiplying a copula C = C'x.y by unit norm copulas 
amount to "shuffling" or "permuting" X and Y respectively, we introduce a 
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new norm, called the *-norm, which is invariant under multiplication by a unit 
norm copula. Mutual complete dependence copulas still has *-norm one. This 
invariant property implies that complete dependence copulas also possess unit 
*-norm. Based on the *-norm, a new measure of dependence is defined in the 
same spirit as the definition by Siburg et al. 21|. It turns out that this new 



measure of dependence satisfies most of the seven postulates proposed by Renyi 
(ig! ]. The only known measure of dependence that satisfies all Renyi's postulates 
is the maximal correlation coefficient. 

This manuscript is structured as follows. We shall summarize related basic 
properties of copulas, the binary operator * and the Sobolev norm in Section 2. 
Then we obtain a characterization of copulas with unit Sobolev norm which im- 
plies that the ^-product of MCD copulas is a MCD copula in Section 3. Section 
4 contains our characterizations of generalized shuffles of Min and (generalized) 
shuffles of copulas in the sense of Durante et al. in terms of the ^-product. 
We then show that shuffling a copula preserves independence, complete depen- 
dence and mutual complete dependence. In Section 5, a new norm is introduced 
and its properties are proved. And in Section 6, we define a new measure of 
dependence and verify that it satisfies most of Renyi's postulates. 



2. Basics of copulas 

A bivariate copula is defined to be a joint distribution function of two random 
variables with uniform distribution on [0, 1]. Since such a joint distribution is 
uniquely determined by its restriction on [0, 1]^ one can also define a copula as 
a function C : [0, 1]^ — > [0, 1] satisfying the following properties 

C(m, 0) = = C(0, v), C{u, 1) = u, C(l, v) = i;, and (1) 

C{u, v) - C(u, y) - Cix, v) + C'ix, y) > (2) 

for all {u, v) e [0, 1]^ and {x, y) e [0, 1]^ such that x < u,y < v. Note that the 
two definitions are equivalent. Every copula C induces a measure fic on [0, 1]^ 

by 

^J.c{[x, u] X [y, v]) = C{u, v) - C{u, y) - C(x, v) -f C{x, y). 
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The induced measure fic is doubly stochastic in the sense that for every Borel 
set B, /ic([0, l]x B) = m{B) = ij.c{B x [0, 1]) where m is Lebesgue measure on 
R. Important copulas include the Prechet-Hoeffding upper and lower bounds 

M(x, y) = min(x, y), W{x, y) = max(a; + y — 1,0) 

and the product, or independent, copula n(a;, y) = xy. A fundamental property 
is that M is a copula of X and Y if and only if Y is almost surely an increasing 
bijective function of X. If X and Y are uniformly distributed on [0, 1] then 
that bijection is the identity map on [0,1]. Its graph, the main diagonal, is 
the support of the induced measure /im, also called the support of M. At the 
other extreme, the minimum copula W{x,y) = max(a; + y — 1,0) corresponds 
to random variables being monotone decreasing function of each other. 

Listed below are some basic properties of any copula C, some of which shall 
be used frequently in the manuscript. 

1. W{x,y) < C{x,y) < M{x,y) for all x,y G [0,1]. 

2. \C{u, v) - C{x, y)\ < \u- x\ + \v - y\ V(m, v), {x, y) e [0, 1]^ and hence C 
is uniformly continuous. 

3. diC and 92 C exist almost everywhere on [0, 1]^. 

4. For a.c. x E [0, 1], diC{x, •) is nondccrcasing in the domain where it exists 
and similar statement holds for d2{-,y)- 

Perhaps, the most important property of copulas is given by the Sklar's theorem 
which states that to every joint distribution function H of continuous random 
variables X and Y with marginal distributions F and G, respectively, there 
corresponds a unique copula C, called the copula of X and Y for which 

Hix,y) = CiF{x),Giy)) 

for all x,y e M. This means that the copula of {X,Y) captures all depen- 
dence structure of the two random variables. X and Y are said to be mutually 
completely dependent if there exists an invertible Borel measurable function / 
such that P{Y = f{X)) = 1. Shuffles of Min were introduced by Mikusinski 
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et al. [13I 1 as examples of copulas of mutually completely dependent random 
variables. By definition, a shuffle of Min is constructed by shuffling (permuting) 
the support of the Min copula M on n vertical strips subdivided by a partition 
= oo < ai < • • • < a„ = 1. It is shown [13, Theorems 2.1 & 2.2] that the 
copula of X and F is a shuffle of Min if and only if there exists an invertible 
Borel measurable function / with finitely many discontinuity points such that 
P{Y = f{X)) = 1. In [l3|, such an / is called strongly piecewise monotone 
function. 

Following ^ ^ , the binary operation * on the set C2 of all bivariate copulas 
is defined as 

C*D{x,y)^ [ d2C{x,t)diD{t,y)dt for x, ?/ e [0, 1] 
Jo 

and the Sobolev norm of a copula C is defined by 

r \WC{x,y)\' dxdy^ f f\diC' (x,y) + d2C' {x,y)) dx dy. 
Jo Jo Jo Jo 

It is well-known that (C2,*) is a monoid with null element 11 and identity M. 

So a copula C is called left invertible [right invertible) if there is a copula D 

for which D * C — M {C * D = M). It was shown in [4, Theorem 7.6] and 

0, Theorem 4.2] that the ^-product on C2 is jointly continuous with respect to 

the Sobolev norm but not with respect to the uniform norm. Moreover, they 

y, [2^ gave a statistical interpretation of the Sobolev norm of a copula. 



Theorem 2.1 ( 
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Theorems 4.1-4.3]). Let C be a bivariate copula of continu- 



2 2 
ous random variables X and Y. Then 1.) — < ||C|| < 1; 2.) \\C\\ = — if anc 

only if C — H; and 3.) The following are equivalent. 

a. ||C|| = 1. 

b. C is invertible with respect to *. 

c. For each x,y e [0,1], diC {■ , y) , 820 {x , ■) € {0,1} a.e. 

d. There exists a Borel measurable bijection h such that Y — h{X) a.e. 

It follows readily that all shuffles of Min have norm one. 
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3. Copulas with unit Sobolev norm 

Let C be a copula with unit Sobolev norm. Then diC{x,y) and d2C{x,y) 
take values or 1 almost everywhere. See, for example, Theorem 7.1 in [4] and 
Theorem 4.2 in [2l|. Let us recall from 14, Theorem 2.2.7] that, for a.e. x £ 
[0, 1], diC{x, y) is a nondecreasing function of y e [0, 1]. Similar statement holds 
also for d2C{x,y). So for a.e. x e [0,1], there is f{x) e [0,1] such that for 
almost every y, diC{x,y) = 1 if y > f{x) and diC{x,y) = ii y < f{x). 
{f{x) = sup{y : diC{x, y) — 0}) Denote the set of such a;'s by / so that m{I) — 1. 
And for every a; G /, by redefining diC{x, y) on a set of measure zero, we may 
assume that diC{x,y) is defined and nondecreasing for all y G [0, 1]. To show 
that / is measurable, let a G [0, 1], and observe that since diC{x, y) is increasing 
in y 

{xei: f{x) > a} = {x e i: 3y > a, diC{x, y) = 0} 

= Q {x e /: diC (x, a + -\ ^0} 

n—l ^ ^ 

which is measurable because each diC{-,a + i) is measurable. In exactly the 
same fashion, there exists a measurable function g: [0, 1] — > [0, 1] for which 

{1 if .T > g{y) 
for a.e. y, a.e. x. 
iix<g{y) 

Let us recall the definition that a measurable function [0, 1] — > [0, 1] is said 
to be measure-preserving if m{4>^^{B)) — m(B) for any Lebesgue measurable 
set B C [0,1]. 

Theorem 3.1. Suppose C is a copula with unit Sobolev norm. Then there 
exists a unique invertible Borel measurable Junction f : [0, 1] — > [0, 1] such that 
f is measure-preserving and for almost every {x,y) in [0,1]^ 

1 ify>f{x) 1 ifx>f^^{y) 

diC{x,y) = ■{ and d2C{x,y) = < (3) 

tfy<f{x) tfx<f-^{y). 
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Furthermore, if f is continuous on an interval I then it is differentiable on I 
with constant derivative equal to either 1 or —1. 

Remark. During the preparation of this manuscript, we have come across sim- 
ilar results such as Proposition 1 in [7|] and Theorem 2.4 and Corollary 2.4.1 in 
fl. 

Proof. We first claim that / and g defined above are inverses of each other in 
the sense that fog and g o f are identity on [0, 1] a.e., i.e. {x: x — g{f{x))} 
and {y: y — fig{y))} both have measure 1. This is equivalent to saying that 
y ~ f{x) if and only if a; = g{y) for a.e. {x,y) G [0, 1]^. Indeed, observe that for 
any open interval B C [0, 1], f{x) £ B \i and only if diC{x,B) ~ {0, 1}. Now 
let A — (01,02) and B ~ (foi,&2) be open intervals in [0,1] for which Ax B 
does not intersect the graph y ~ f{x), i.e. m {{x E A: f{x) E B}) = 0, hence 
diC{x, y) is independent of y e i? for a.e. x E A. So diC{x, y) — 5{x) = Q ov 1 
for a.e. x E A and all y E B. Then for (x, y) \n Ay. B 

C{x,y)^ diC{t,y)dt= diC{t,y)dt+ 6{t) dt ^ C{ai,y)+ 6{t)dt 

Jq Jo Jai Jai 

and so d2C{x, y) — d2C{ai, y) is independent oix E A which implies that Ay. B 
does not intersect the graph x — g{y). The converse can be shown by a similar 
argument. Since the graph of a Borel function is a Borel subset of [0, 1]^, 
y — f{x) and x = g{y) give the same graph. And the claim follows. 

Let He denote the doubly stochastic measure associated with C . A straight- 
forward verification gives 

,ic{AyB)^7n{Anf-\B)) (4) 

for all Borel rectangles A y B, which implies by a standard measure-theoretic 
technique that ^ holds for all Borel sets A, _B C [0,1]. So / is measure- 
preserving since it is equivalent to the validity of @ for all Borel sets A and 
B. 

Lastly, we prove that if / is continuous on an open interval / = (a, h) then it 
is differentiable with /' being constant and equal to ±1. Since / is continuous 
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and one-to-one on 7, it has to be strictly monotonic on I. Let us consider the 
case where / is strictly increasing on I. This implies that g = is strictly 
increasing on the interval /(/) and that y > f{x) if and only if a; < g{y) for 
X £ I. For X e [ao, bo] C (a, 6), 

/•aa rx i-x 

C{x,y)= diC{t,y)dt+ diC{t,y) dt = C{ao,y) + X{t: y>f{t)} dt 

Jo Jao Jao 

X — ao if X < g{y), 

= C{ao, y)+ X[o,g(v)) dt = C{ao,y) + < 

"^"o giy) -ao if X > giy). 

V 

Since C(x, y) and C(ao, y) are differentiable with respect to y almost everywhere, 
we have for a.e. y, 



d2C{x,y) = d2C{ao,y) 



if a; < g{y) 
g'{y) if X > g{y). 



As g'{y) > and d2C{x,y) and d2C{ao,y) are equal to or 1, g'{y) = 1 and 
hence f'{x) = 1 for all x & I. Similarly, if / is strictly decreasing on (a, 6) then 
/' = —1 a.e. on (a, 6). □ 

A natural question is then to investigate the set on which an invertible 
measure-preserving function / is continuous. Unfortunately, the support of a 
unit norm copula may be the graph of a function which is discontinuous on a 
dense subset of [0, 1], and hence there is no interval on which it is continuous. 

Example 1. Define a sequence of shuffles of Min {5„} by letting Sq be the 
comonotonic copula supported on the main diagonal. 5*1 is defined so that it 
shares the same support with So in [0, ^] x [0, 1] and its support in the other half 
Fq X [0, 1] = [i, 1] X [0, 1] is that of 5*0 flipped horizontally. 5*2 is then obtained 
from iS*! by flipping the support in each stripe of the set Fi x [0, 1] where Fi = 
\\ U ([^, \\^\). For general n > 1, we define F„ ^ ^F„^i U (i^n-i + ^) 
and let the shuffle of Min 5„ be obtained from 5„_i by flipping the support in 
each stripe of F^ horizontally. To sum up, each shuffle of Min S'„ is supported 
on the graph {(x, y) : y = fn{x)} where /„ is constructed according to the above 
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Figure 1: Si, S2, and Sg 



iterative procedure, starting from /o(x) = x and fi{x) = x X[o + ~ ^) X[i i]- 
The first few SnS are illustrated in Figure [H 



From construction, Fn consists of 2" stripes, each of width 



2«+i 



On each 



of these stripes, the supports of 5„ and differ by a flip which implies 

that ^Mr- and ^^g^ ^ are equal on the stripe except on two triangles of total 



area 



dx 
1 /' 1 



2 V2" 

Therefore, 



where 



ds„ 



dS„ 



dS„ 
dy 



dS„-i 



dy 



1. Similarly, on each stripe of 
1 



= 1 on two triangles of total area tt^^^ and zero elsewhere. 



\\Sn 'S'n — ill — 

Now, given m < n, 

||5„-5„,|| < 



/2 



dx 



dx 



dy 



dy 



dx dy — 



1 



2«+2- 



n 



E 

k—m+l 



Sh — Sh 



1 " 1 

fc=m+l 



which converges to as m, n — )■ 00. Since the set of copulas is complete with 
respect to the Sobolev norm (see p. 424 in ^), the Cauchy sequence {Sn} 
converges to a copula S. It follows that ||S'|| = 1. It can also be shown that the 
support of S contains the graph of the pointwise limit / of /„. 



9 



Finally, we shall show that the mutual complete dependence copula S has 
support on the graph of a function discontinuous on the set of dyadic points in 
[0, 1]. In fact, it is straightforward to calculate the jump of / at a dyadic point 
^ where k is indivisible by 2: 

111 1 



/ 1 2"+ ) -^12" 



> 0. 



We note here that the support of S is self-similar with Hausdorff dimension one. 



A surprising fact by Mikusinski, Sherwood and Taylor |13l . Theorem 3.1] is 
that every copula, in particular the independence copula, can be approximated 
arbitrarily close in the uniform norm by a shuffle of Min. Consequently, the 
uniform norm cannot distinguish dependence structures among copulas. How- 
ever, if {Sn} is a sequence of shuffles of Min converging in the Sobolev norm 
to a copula C, then it is necessary that ||C|| — 1, hence C is a copula of two 
mutually completely dependent random variables. Conversely, one might ask 
whether any copula C with ||C|| = 1 can be approximated arbitrarily close in 
the Sobolev norm by a shuffle of Min. We quote here without proof a result 
from which will be useful in answering the question. 



Theorem 3.2 (Chou and Nguyen For every measure-preserving function f 
over [0, 1], there exists a sequence of bijective piecewise linear measure-preserving 
functions {/„} whose slopes are either +1 or —1 and such that /„ converges to 
f a.e. 

Lemma 3.3. Let Ci and C2 be copulas with norm one which are supported on 
the graphs of fi and f2, respectively. Then 

llCi-C^f <2|l/i-ML.. (5) 

Proof. By assumption, for a.e. {x,y), \diCi{x,y) — diC2{x,y)\ = 1 if and only 
if y is between fi{x) and f2{x). Likewise, \d2Ci(x,y) — d2C2{x,y)\ = 1 if and 
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only if X is between f[ ^\y) and ^\y) for a.e. {x,y). So 

\\Ci - - /' 1/1 (x) - + /' fi-'\y) - ft'\y) ' dy 

Jo Jo 

< [' \h{x) - h{x)\' dx + f ft'\y) - ft'\y) dy 

Jo Jo 

^ll/i-Mli. + ll/i-MLi < 211/1 -MLi. 

□ 

Theorem 3.4. For any copula C with \\C\\ = 1, there exists a sequence of 
shuffles of Min {Sn} such that \\C — Sn\\ 0. 

Proof. Suppose C is a copula with norm one and C is supported on the graph 
of /. It follows from Theorem 13 . 1 1 that / is a measure-preserving bijcction from 
[0, 1] onto itself. By Theorem 13. 2[ one can construct a sequence of measure- 
preserving functions {/„} for which each /„ is bijective piecewise linear with 
slopes +1 or —1 and /„ converges to / a.e. A corresponding sequence of shuffles 
of Min {Sn} can then be chosen so that the graph of /„ is the support of 5„. 
By Lemma [531 ||C — S*,!!]^ < 2 ||/ — /„ || ^. Since / — /„—> a.e., an application 
of dominated convergence theorem shows that ||/ — /n||i — > 0. Consequently, 
Sn — > C in the Sobolev norm. □ 

Remark. From the proof, it is worth noting that one can approximate a copula 
C by only straight shuffles of Min whose slopes on all subintervals are -1-1. 

Corollary 3.5. Let U,V 

1. If\\U\\ = 1 and \\V\\ = 1 then \\U *V\\ = 1. 

2. i/ ||C/ * V\\ = 1 then \\U\\ = 1 if and only if \\V\\ = 1. 

Proof. 1. Let /7, F e £ be such that |1I7|| = 1 and \\V\\ = 1. By Theorem 
13.41 there exist sequences {Sn}, {Tn] of shuffles of Min such that Sn — > U 
and Tn V in the Sobolev norm. Hence, with respect to the Sobolev norm, 
Sn * Tn ^ U * V hy the joint continuity of the ^-product. Since a product of 
shuffles of Min is stiU a shuffle of Min, ||C/ * =1. 
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2. LetUa.ndU*V be copulas of Sobolev norm 1. Since H?/'^!! = |1C/|1 = 1, 
an application of 1. yields ||V^|| = \\U'^ * {U * V)\\ =1. □ 

4. Shuffles of Copulas and a Probabilistic Interpretation 

At least as soon as shuffles of Min were introduced in uM , the idea of simple 

n 

shuffles of copulas was already apparent. See, e.g., [Ij, p. 111]. In 8], Durante, 
Sarkoci and Sempi gave a general definition of shuffles of copulas via a character- 
ization of shuffles of Min in terms of a shuffling St - [0, 1]^ — > [0, 1]^ defined by 
St{u, v) — {T{u), v) where T: [0, 1] — > [0, 1]. Before stating their results, let us 
recall the definition of push-forward measures. Let / be a measurable function 
from a measure space (f2,i5, /i) to a measurable space A push-forward 

of ^ under f is the measure / * ^ on defined by / * fi{A) — fi{f^^{A)) 

for A e di- 

Theorem 4.1 ( ^, Theorem 4]). A copula C is a shuffle of Min if and only if 
there exists a piecewise- continuous measure-preserving bijection T: [0, 1] — > [0, 1] 
such that — St * ^J'M■ 

Dropping piecewise continuity of T, a generalized shuffle of Min is defined as 
a copula C whose induced measure is /ic = St* Mm for some measure-preserving 
bijection T: [0, 1] [0, 1]. Replacing M by a given copula D, a shuffle of D is 
a copula C whose induced measure is 

He ^ St * fJ-D (6) 

for some piecewise-continuous measure-preserving bijection T. C is also called 
the T-shuffie of D. If the bijection T is only required to be measure-preserving 
in then C is called a generalized shuffle of D. 

The following lemma will be useful in our investigation. 

Lemma 4.2. LetT he a measure-preserving bijection on [0, 1] and C be a copula 
defined by 

C{x,y) = St * fJ-M {[0,x] x [0,y]) for x,y e [0,1]. 
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Then the copula C , or equivalently its induced measure fic = * fJ-Ai, 'is sup- 
ported on the graph ofT^^. Moreover, the converse also holds, i.e. if C is sup- 
ported on the graph of a measure-preserving bijection T then fic — S^-^ * ^-m- 

Proof. Let [a, h] x [c, d] be a closed rectangle in and St be the map on [0, 1]^ 
associated with a given measure-preserving bijection T on [0, 1], i.e. St{u,v) = 
{T{u),v). So {[a,b] x [c,d]) = {T-'^[a,b]) x [c,d] and, by definition of the 
push-forward measure, 

St * MAf ([a, b] x [c, d]) = (S't^ ([a, b] x [c, d])) 

= fiM {{T-^[a,b]) X [c,d])^m{{T~^[a,b])n[c,d]). 

Thus, St * ([a, &] x [c, d]) = if and only if the projection of graph(T^^) n 
([a, b] X [c, d]) onto [c, d] has measure zero. Consequently, since Borel measurable 
subsets of [0, 1]^ are generated by rectangles, the desired result is obtained. □ 

Theorem 4.3. A copula C is a generalized .shuffle of Min if and only j/||C|| = 1. 

Proof. Let C be a generalized shuffle of Min, i.e. there exists a measure 
preserving bijection T on [0,1] such that fic — St * fJ-M- By Theorem 13.21 
there is a sequence {Tn} of piecewise-continuous measure-preserving bijection 
on [0, 1] such that T„ — T a.e. So C„(x,y) — S't„ * fJ-M ([0,a;] x [0,y]) defines a 
sequence of shuffles of Min. We claim that ||C„ — C|| — > 0. In fact, by Lemma 
14.21 C — St * fJ-M and C„ — St„ * fJ-M are supported on the graphs of T^^ and 

respectively. Now, Lemma [33] implies that ||C„ - Cf < 2 ||T~i - T''^ 
which converges to as a result of the Lusin-Souslin Theorem (see, e.g.. 
Corollary 15.2]) which states that a Borel measurable injective image of a Borel 
set is a Borel set and the dominated convergence theorem. Therefore, C„ — >■ C 
in the Sobolev norm. 

(<^=) Let C be a copula with ||C|| ~ 1. Then Theorem 13.11 gives a measure- 
preserving bijection / whose graph is the support of C. So Lemma 14.21 implies 
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that fic — Sf-i * fiAi- □ 
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Theorem 4.4. ///i and v are doubly stochastic measures on [0,1]^ then 
H*iy{IxJ)^[ d2n{I,t)dii^{t,J)dt 



induces a doubly stochastic (Borel) measure ^ * v on [0, 1]^, where 

82^(1, t) = ^fi{I X [0, t]) and div{t, J) = -^i^([0, t] x J). 

Furthermore, if A and B are copulas and o.nd fis denote their doubly stochas- 
tic measures then 

IJ-A*B = l^A* IJ-B- (7) 

Proof. We shall prove only ([7]) which shows that /i * is a doubly stochastic 
measure when the measures /i and v are doubly stochastic and inducible by 
copulas. Let A and B be copulas and / = [ai, 02], J = 62] C [0, 1]. Then 

MA*i3(/x J)= / [d2A{a2,t)diB{t,b2)~d2A{ai,t)diB{tM) 







^2^(02, t)diB{t, bi) + d2A{ai,t)diB{t, 61)] dt 



= / d2iA{a2,t) - A{ai,t))di{B{t,b2) - B{t,bi) dt 







^ ^Ma(/x [0,t])^^B([0,t] X J)di 
= * X J). 

The usual measure-theoretic techniques allow to extend this result to the prod- 
uct of all Borel sets. □ 

Lemma 4.5. Let T be a measure-preserving bijection on [0, 1] and fi, v be 
doubly stochastic measures on [0, 1]^. Then 

St * (/i * i^) = {St * ^) * v. 
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Proof. Let I and J be Borel sets in [0, 1]. Then 

{St * (Ai * i^)) (/ X J) = * I/) (5y ^(/ X J)) = * I/) (r-i(/) X j) 

= / d2fi{T-\l),t)diiy{t,J)dt 
Jo 

= [ d2{ST* fi){I,t)dii^{t,J)dt 
Jo 

= {{St * ^x) * v) {I X J). 

□ 

Theorem 4.6. Let C and D be bivariate copulas. Then 

1. C is a shuffle of D if and only if there exists a shuffle of Min A such that 
C ^ A^D; 

2. C is a generalized shuffle of D if and only if there exists a generalized 
shuffle of Min A such that C — A * D . 

Proof. We shall only prove 2. since 1. is just a special case. 

If C is a shuffle of D, i.e. = St * iJ-o for some measure-preserving 
bijection T of [0, 1], then the copula A defined by ha — St * f^M is a shuffle of 
Min by Theorem g^l Then 

fj,c = St fJ-D = St fJ-AitO — St {ij-m * IJ-d) — {St * Mm) * M_d — IJ-a* f'D 

which means that C = A* D. 

{<=) If C = A * _D for some copula A with = 1 then ha = St * Mm for 
some measure-preserving bijection T and 

— IJ'A*D — fJ-A^fJ-D — {St*I^m)*IJ'D = St*{iJ'M * Md) = St*I^M*D = St^I^D- 

Note the repeated uses of Theorem 14.41 and Lemma in both derivations. □ 

Remark. Since 11 is the only null element of * (see [jI), it follows easily from 
Theorem 14.61 that 11 is the only copula which is invariant under shuffling by 
generalized shuffles of Min. This is a result first proved in [Sj, Theorem 10]. 
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Even though all generalized shuffles of Min have equal unit norm, not all 
shuffles of C have the same norm. Here is a class of examples. 

Example 2. For < a < 1, let denote the straight shuffle of Min whose 
support is on the main diagonals of the squares [0,a] x [1 — a, 1] and [a, 1] x 
[0, 1 — a]. Then by straightforward computations, for any copula C, 

C(x + l-a,y)-C(l-a,y) if < x < a, 
y — C(l — a,y) + C{x — a,y) if a < x < 1, 

/■I 

||5„*Cf - ||C||'+ / (92C(l-a,j/)-(l-a))'dy 

JQ 

-2 f f d2C{x,y){d2C{l-a,y)~{l~a))dxdy. (8) 
Jo Jo 

Let us now consider the Farlie-Gumbel-Morgenstern (FGM) copulas Ce, 9 G 
1, 1], defined by Cg{x, y) ^ xy + 9xy{l — x){l — y). Then 

J ((92Ce(l-a,y)-(l-a)) dy ^ 

and 

2 r d^Ceix, y) {d^Ceil - a,y) ~ {1 ~ a)) dx dy ^ ^^'"^^ ~ . 
Jo Jo 

So that ||5a * Cef = \\Cef - '^'"^3'°^ (| - a{l - a)) which is equal to ||Ce||^ 
only if 6* = or a = or 1. For each 6* 7^ 0, ||Ce||^ — \\Sa * Ce\\'^ is maximized 
when a = and the maximum value is jp- . 

Proposition 4.7 ( 4], p. 610). If Z and Y are conditionally independent given 
X, then CzY = Cz,x * Cx,y- 

Proposition 4.8. Let h: M. ^ M. be Borel measurable and X,Y be random 
variables. Then h(X) and Y are conditionally independent given X . 

Proof. Since h is Borel measurable, h{X) is measurable with respect to cr{X), 
the (T-algebra generated by X . Hence, by properties of conditional expectations, 

E{h^X)<a\X){L0) ■ EilY<b\X)i0j) = 4(X)<a(^) ' E{lY<b\X)ioj) 

= Eih^X)<a-lY<b\X)iuj) 
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for all uj E n. This completes the proof. □ 
Corollary 4.9. Let /, 5: M — > R &e Borel measurable Junctions. Then 

Cf{X).X * Cx,Y * CY,g(Y) = Cf(X),g{Y) 

for all random variables X, Y . 

Proof. Since / and g are Borel measurable, by Propositions I4.7l and l4.81 we have 

Cf(x)x = Cf(x),x * Cx,Y and Cg(Y),x = Cg(Y),Y * Cy,x (9) 

for all random variables X, Y. Transposing both sides of we obtain Cx.g(Y) = 
Cx.Y * CY,g{Y)- Then, we have 

Cf{X},g{Y) — Cf(^x),X * Cx,g{Y) — Cf(X),X * Cx,Y * C'y^c,(F) • (10) 

□ 

Definition 1. Let U,V E InvC, the set of invertible copulas or, equivalently, 
the set of copulas with unit Sobolev norm. A shuffling map Su,v is a map on 
span £ defined by 

Su.y{A) ^U*A*V. 

The motivation behind the word "shuffling" comes from the fact that a 
shuffling image of a copula is a two-sided generalized shuffle of the copula. Note 
that C is invertible <^ \\C\\ = \ ^ C is a, generalized shuffle of Min. 

Lemma 4.10. Let X,Y be continuous random variables and U,V E InvC 
Then the following statements hold: 

1. X and Y are independent if and only if Su.v{Cx.y) = H. 

2. X is completely dependent on Y or vice versa if and only if Su,v{Cx,y) 
is a complete dependence copula. 

3. X andY are mutually completely dependent if and only if Sij,v{Cx,y) is 
a mutual complete dependence copula. 
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Proof. 1. This clearly follows from the fact that IT is the zero element in (£, *). 

2. With out loss of generality, let us assume that Y is completely dependent 
on X, i.e. there exists a Borel measurable transformation h such that Y = h{X) 
with probability one. Let / and g be Borcl measurable bijective transformations 
on R such that U — Cf(x).x and V — CY.g{Y)- By Corollary 14.91 we have 

Suy{Cx,Y) = Cf(x),X * Cx,Y * CY,g(Y) = Cf{X),g(Y)- 

Thus, it suffices to show that g{Y) is completely dependent on f{X). From 
Y = h{X) with probability one, g{Y) = {g o h){X) = (50/10 J-^){f{X)) 
with probability one. It is left to show that /^^ is Borel measurable. This is 
true because of Lusin-Souslin Theorem (see, e.g., [ill, Corollary 15.2) which 
states that a Borel measurable injective image of a Borel set is a Borel set. The 
converse automatically follows because the inverse of a shuffling map is still a 
shuffling map. 

3. The proof is completely similar to above except that the function h is 
also required to be bijective. □ 

Corollary 14.91 implies that a shuffling image of a copula Cx,y is a copula 
of transformed random variables C f(^x),g(Y) for some Borel measurable bijec- 
tive transformations / and g. Together with the above lemma, we obtain the 
following theorem. 

Theorem 4.11. Let X and Y be continuous random variables. Let f and g 
be any Borel measurable bijective transformations of the random variables X 
and Y , respectively. Then X and Y are independent, completely dependent or 
mutually completely dependent if and only if f{X) and g{Y) are independent, 
completely dependent or mutually completely dependent, respectively. 

The above theorem suggests that shuffling maps preserve stochastic proper- 
ties of copulas. In the next section, we contruct a norm which, in some sense, 
also preserves stochastic properties of copulas. 
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5. The *-norm 

Our main purpose is to construct a norm under which shuffling maps are 
isometrics and then derive its properties. 

Definition 2. Define a map || • ||* : spanC— >■ [0, oo), by 

P||,= sup \\U*A*V\\. 

U,Velnv£ 

By straightforward verifications, ||-||^ is a norm on spanC, called the *-norm. 
Moreover, it is clear from the definition that ||A|| < for all A e span(i. 

The following proposition summarizes basic properties of the *-norm. Ob- 
serve that properties 2.-4. are the same as those for the Sobolev norm. 

Proposition 5.1. Let C G £. Then the following statements hold. 

1. ||c|U = i */||c|| = i. 

2. ||C||2 = I «/ and only if C = 11. 

3. \\C-Il\\l = \\C\\l-l 

4. \\A^\\, = \\A\\, for all A e spanC. 

Proof. 1. is a consequence of the inequality ||Cj| < ||C||* < 1. 2. follows from 
the fact that 11 is the zero of (£, *). To prove 3., we first observe that 

\\U*{C -Il)*V\\^ = \\U*C*V -Uf = \\U*C*Vf - I 

for all U,V £ Inv €. The result follows by taking supremum over U,V G Inv £ 
on both sides. Finally, using the facts that ||C/^|| = ||[/|| for all ?7 e (i, 

m^||*= sup \\U*A'^*V\\= sup \\V^*A*U'^\\ 

U,VGlnvC U,VGlnv£ 

sup \\V^ * A*U'^\\ = sup \\U*A*V\\ = \\A\\^. 

□ 

Theorem 5.2. Let A e spanC and U G lnv€. Then \\U * A\\^ = \\A\\^ = 
\\A * U\\^. Therefore, shuffling maps are isometrics with respect to the *-norm. 
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Proof. We shall prove only one side of the equation as the other can be proved 
in a similar fashion. Let A S span £ and Uo E Inv £. Then by Corollary 13.51 
for any C G £, L/q * C G Inv£ if and only if C G InvC. Hence, \\Uo * = 
suPuyeinveWiU *Uo)*A*V)\\ = sTxpuy^^^^^WU *A^V\\ = □ 

Example 3. From Example^ let a G (0, 1), 6 G [-1, 1]\{0} and Ag = Si/2*Ce. 
Then Si/2 *Ae = Ce- Since \\Ae\\ < \\Ce\\ for any 6:^0. Then 

Pell* > 11^1/2 *Ae|| = llCell > \\Ae\\. 

Hence, the Sobolev norm and the *-norm are distinct. 



Example 4. Let a G [0, 1] and C be a copula. Recall that one can show 

using only the property ||C — n||^ = ||C||^ ^ | the norm ||-|| (see that 

||aC+ (1 — a)H||^ = ^ l) + §• Since the *-norm shares this same 
property with the Sobolev norm (see Proposition |5JJj3l) ) , we also have 

\\aC+il-a)U\\l=a' _ + | 

So ||aC+(l-a)H||2 = ||aC+(l-a)H|p for aU copulas C satisfying ||C||^ = ||C||. 
In particular, the Sobolev norm and the *-norm coincide on the family of convex 
sums of an invertible copula and the product copula, where the norms are equal 
to {a^ + 2)/3. 

Lemma 5.3. Let A C [0, 1] be a Borel measurable set. Define the function 
SA ■■ [0, 1] ^ [0, 1] by 

{■m(\0,x]nA) ifxeA, 
(11) 
m{A) +m{[0,x]\A) if x i A. 

Then sa is measure-preserving and essentially invertible in the sense that there 
exists a Borel measurable function tA for which sa ° tA{x) = x — tA ° sa{x) 
a.e. X G [0, 1]. Such a tA is called an essential inverse of sa- 

Proof. Clearly, sa is Borel measurable. 
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• SA is measure-preserving: It suffices to prove that m(s^^[0, b]) = m([0, b]) 
for all b e [0, 1]. Now if 6 < m{A), then 

s-i[0,6] ^{xeA: s{x) e [0,b]} ^ {x e A: m{An [0,x]) < b} . 

By continuity of m, there exists a largest xq such that m(An [0, 1'o]) = Then 
s^^[0,6] = An{a;: m(A n [0,x]) < 6} = A n [0,a;o]. Therefore, to(s^1[0,&]) = 
m{A n [0, a;o]) = b. The case where b > m(A) can be proved similarly. 

• SA is essentially invertible: Using continuity of m, we shall define an aux- 
iliary function tA on [0, 1] as follows. If y < 'm{A), there exists a corresponding 
x G A such that m{[0,x] O A) = y. If y > m{A), there exists a correspond- 
ing X ^ A such that m{A) + m ([0, x]\A) — y. In these two cases, we define 
tA{y) — X. Generally, Ia is not unique as there might be many such x^s. 

We shall show that sa is injective outside a Borel set of measure zero by 
proving that l = tA° sa the identity map on [0, '^] \ Z for some Borel set Z of 
measure zero. U x E A then sa{x) < m{A) so that l{x) E A and m([0, i{x)] Ci 
A) = sa{x) — to([0, x] n A). Similarly, if x ^ A then sa{x) > m{A), l ^ A and 
7Ti([0, l{x)] \A)= m{[0, x]\A). Consider the set of all x E A for which l{x) ^ x. 
If i{x) < X then m {{l{x), x] H A) = which implies that 

m ((x — r,x + r) n A) m((x,x + r) D A) 1 

lim = lim < - (12) 

r^o+ 2r r^o+ 2r ~ 2 ^ ^ 

wherever exists. Now, a simple application of the Radon-Nikodym theorem (see, 
e.g., 0]) yields that the limit in (|12l) is equal to 1 for all a; € ^ \ ^ where Z 
is a Borel set of measure zero. Therefore, {x E A: l{x) < x} has zero measure. 
Similarly, {x E A: l{x) > x} is a null set and hence m {{x E A: l{x) ^ x}) = 0. 
Therefore, l{x) = tA° sa{x) — x except possibly on a Borel set Z of measure 
zero. 



By the Lusin-Souslin Theorem (see, e.g., [Ill, Corollary 15.2]), the injective 
Borel measurable function sa, mapping a Borel set [0, 1] \ ^ onto a Borel set 
S/i([0, 1] \ Z), has a Borel measurable inverse, still denoted by tA- Now, since 
SA is measure-preserving, its range which is the domain of Ia has full measure. 
This guarantees that Ia can be extended to a Borel measurable function on [0, 1] 
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which is an essential inverse of sa- 



□ 



Theorem 5.4. Let X, Y be random variables on a common probability space 
for which Y is completely dependent on X or X is completely dependent on Y . 
Then \\Cx.y\\* = 1- 

Proof. Assume that Y is completely dependent on X. Then C = Cx,y is 
a complete dependence copula for which C = Cjjj^u) where C/ is a uniform 
random variable on [0,1] and /: [0,1] [0,1] is a measure-preserving Borel 
function. Note that f{U) is also a uniform random variable and that C is left 
invertible. 

As the first step, we shall construct an invertible copula 5*1 such that Si^C is 
supported in the two diagonal squares [0, l/2]2u[l/2, 1]^. Let A = /"^([0, 1/2]), 
denote s = sa as defined in (fTTjl and put Si ~ Cs(u).u- By Lemma [5.31 s is 
invertible a.e. and hence Si is invertible. By Corollarv l4.9[ 

where V = s{U) is still a uniform random variable on [0, 1]. It is left to verify 
that the support of S*! * C lies entirely in the two diagonal squares which can 
be done by showing that the graph of / o s^^ is contained in the area. In fact, 
since s'\[0,^]) C A, it follows that (/ o s-i)([0, i]) C f{A) C [0, i]. The 
inclusion (/ o s^^)([i,l]) C [^,1] can be shown similarly. As a consequence, 
5*1 * C can be written as an ordinal sum of two copulas, C'l and C2, with respect 
to the partition {[0, ^], [^, 1]}. Since left-multiplying a copula C by an invertible 
copula amounts to shuffling the first coordinate of C, it follows that Ci and C2 
are still supported on closures of graphs of measure-preserving functions. 

Next, we apply the same process to Ci and C2 which yields invertible copulas 
Ai and A2 for which Ai * Ci and A2 * C2 are both supported in [0, i]^ U [i, 1]^ 
and define S2 to be the ordinal sum of Ai and A2 with respect to the partition 
{[0, i], [i, 1]}. 5*2 is again an invertible copula. Then the support of 5*2 * 5i * C 
is contained in the four diagonal squares IJ^^^ [t^i i]^- Therefore, S2* Si*C 
is an ordinal sum with respect to the partition {[0, -j], [|;, ^], [^, |], [|, 1]} of 
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four copulas each of which is supported on the closure of graph of a measure- 
preserving function. By successively applying this process, we obtain a sequence 
of invertible copulas {Bn}^^i, defined by Bn — Sn * ■ ■ ■ * S2 * Si, such that the 
support of Bn * C is a subset of the 2" diagonal squares. So Bn * C —> M 
pointwise outside the main diagonal and so are their partial derivatives. Hence 
\\Bn * C'W 1. Thus ||C||* = 1. 

If X is completely dependent on Y then C = Cx.y is right invertible and 
similar process where suitably chosen S'„'s are multiplied on the right yields a 
sequence {Bn} of invertible copulas such that \\C * Bn\\ — > 1 as desired □ 

Corollary 5.5. Let L and R be left invertible and right invertible copulas, 
respectively. Then ||L * = 1. 

Proof. From Theorem 15. 41 there exist sequences of invertible copulas 5„ and T„ 
such that Sn * L M and i? * T„ — M in the Sobolev norm. By the joint 
continuity of the ^-product with respect to the Sobolev norm, Sn ^ L ^ R, ^ T^i )■ 
M * M = M. Therefore, ||L * = 1. □ 

Let us give some examples of copulas of the form L * R. Consider a copula 
C, C'^ and C*C^ whose supports are shown in the figure below. As mentioned 



Figure 2: the supports of C, and C * , respectively 

before, the copula C * , though neither left nor right invertible, has unit 
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6. An application: a new measure of dependence 

In [icj l. Renyi triggered numerous interests in finding the "right" sets of 
properties that a natural (if any) measure of dependence d{X, Y) should possess. 
For reference, the seven postulates proposed by Renyi are listed below. 

a. 6{X,Y) is defined for all non-constant random variables X, Y. 

b. S{X,Y) = 5{Y,X). 

c. S{X,Y)e [0,1]- 

d. 6{X, y) = if and only if X and Y are independent. 

e. S{X,Y) = 1 if either Y = f{X) or X ^ g{Y) a.s. for some Borel- 
measurable functions /, g. 

f. If a and P are Borel bijections on M then 5{a{X), I3{Y)) = 5{X,Y). 

g. If X and Y are jointly normal with correlation coefficient p, then 5{X, Y) = 



Thus far, the only measure of dependence that satisfies all of the above postu- 
lates is the maximal correlation coefficient introduced by Gebelein [l^ . See for 
instance QQ- ^ 

Recently, Siburg and Stoinienov 21] introduced a measure of mutual com- 
plete dependence lo{X, Y) defined via its copula Cx,y by ijj{X, Y) ~ V3\\Cx,y~ 
n||. While Lu is defined only for continuous random variables, it satisfies the next 
three properties |bl-[dl enjoyed by most if not all measures of dependence. How- 
ever, instead of the conditionsm and|B, ui satisfies the following conditions which 
makes it suitable for capturing mutual complete dependence regardless of how 
the random variables are related. 

m' U!{X, F) = 1 if and only if there exist Borel measurable bijections / and 
g such that Y = f{X) and X ~ g{Y) almost surely. 

13' If a and /3 are strictly monotonic transformations on images of X and Y , 
respectively, then u}{a{X), (3{Y)) = uj{X,Y). 
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Now, the property |3' means that uj is invariant under only strictly monotonic 
transformations of random variables. Using the *-norm which is invariant 
under all Borel measurable bijections, we define 

where the last equality follows from Proposition lS. iT 3) . Since the *-norm shares 
many properties with the Sobolev norm (see Proposition 15. ip . the properties of 
oj, are for the most part analogous to those of w's. Main exceptions are that 
m'-lB' are replaced back by|el-|3 

Theorem 6.1. Let X and Y be continuous random variables with copula C. 
Then oj* {X, Y) has the following properties: 

1. Lu,{X,Y) ^Lu4Y,X). 

2. < uj4X,Y) < 1. 

3. ujf{X,Y) — if and only if X and Y are independent. 

4. (X, y) = 1 if Y is completely dependent on X or X is completely de- 
pendent on Y . 

5. // / and g are Borel measurable bijective transformations, then we have 
LU,{f{X),g{Y))^Lu4X,Y). 

6. If {{XmYn)}neN is a sequence of pairs of continuous random variables 
with copulas {C„}„£n o,nd if lim ||C„ — C||* = 0, then lim uj<,{XmYn) = 

n— >cxD n— fCJO 

^*{X,Y). 

Proof. 1. follows from the fact that ||Cx,y||* = ||C'y,x||*- See Proposition 15.11 
2. is clear from the definition of || • ||* and the fact that ||Cx,y|P G [2/3, 1]. The 
statement 3. is a result of Proposition 15.11 which says that ||Cj(:^y||^ — 2/3 if 
and only if Cx.y — H. 4. follows immediately from Theorem 15.41 To prove 5., 
let f,g be Borel measurable bijective transformations. Then, X and f{X) are 
mutually completely dependent, and so are Y and g{Y). Thus ||C/(x).x|| — 1 
and ||Cyg(y-)|| = 1. Therefore, the copulas Cf(^x),x ^-nd Cy ^jy) are invertible. 
Hence uj,{f{X),g{Y)) = ^/i\\Cf(x),x * {Cx,y ~ H) * Cy^g(y)||, = V3\\Cx,y - 
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n||* = Y). Finally, 6. can be proved via the inequality 

|w,(x„,y„)-c^,(x,r)| = V3|||c„-n||,- ||c-n||,| < V3||c„-c|U. 

□ 

Therefore, we have constructed a measure of dependence for continuous ran- 
dom variables which satisfies all of Renyi's postulates except possibly the last 
condition |g] The *-norm of a convex sum of a unit *-norm copula and the 
independence copula is computed. 

Example 5. By the computations in Example HI if = 1 and Cx.y = 

aA+{l~a)Il, then uj^X^Y) = [S{a^ + 2)/3 - 2]^^^ = a. 

Corollary 15.51 implies that there are many more copulas with unit *-norm, 
i.e. any copulas of the form C'x.f{x) * Cg(y).y where f,g are Borel measur- 
able transformations. By the characterization of idempotent copulas in ;(|, all 
singular idempotent copulas are of this form and hence have unit *-norm. 
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